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This interview-based white paper was written based on a SIOP Top 
Minds and Bottom Lines event that took place in April of 2016 at the 
SIOP Annual Conference in Anaheim, CA. Top Minds and Bottom 
Lines is an events series put on by SIOP to engage members of the 
business community in the science of 1-0 psychology an to help pro¬ 
mote the use of evidence-based management. 
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Introduction 

Translating mountains of data into smart decisions involves asking the right 
questions, determining the appropriate data, knowing how to data-dig and com¬ 
bine data elements, and applying the right analytics to implement a successful 
business strategy. Harnessing all of that information to its fullest advantage is 
not simple, but is increasingly considered best practice to solve business chal¬ 
lenges. In this interview, three experts in big data share their lessons learned 
and discuss how and when big data really matters. (Note: For brevity, author 
initials are used to identify responses. As told to Jolene Skinner, PhD) 


How has industrial-organizational psychology helped you to be a big data ex 
pert? 


Alexis Fink (AF): Big data is a tool. It’s a powerful one, and it opens up opportunities 
to discover things that would have been unknowable just a few short years ago. But 
the tool alone can’t create insight, knowledge, or change. 1-0 psychology has a centu¬ 
ry of history around the basic mechanics analyzing and influencing areas like manage¬ 
ment, leadership, teamwork, selection, performance and performance management. I- 
O psychology also benefits from a solid grounding in ethics. All of this means that 
while many of my non-l-0 peers in Big Data are as good or better than me with sen¬ 
sors, machine learning and other Big Data bells and whistles, I am better than they are 
at formulating questions, warning of danger, and translating insight into action. Enor¬ 
mous volumes of sensor data is meaningless without those good questions and useful 
actions! 

Sara Roberts (SR): The scientist-practitioner model of 1-0 Psychology provides an 
optimal balance between science (i.e., research, data, analysis) and practice (i.e., ap¬ 
plying the scientific approach in the real world). This blend between science and prac¬ 
tice has provided me with the expertise necessary to gather and analyze “big data”, 
while not losing sight of what’s really important - turning insights into action in order to 
maximize the effectiveness of organizations. Additionally, I believe the focus that 1-0 
Psychology places on research methods has also helped me to become a big data ex¬ 
pert, and isn’t necessarily a focus within other related disciplines such as mathematics 
or data science. Having a deep understanding of research methods not only ensures 
that you start with a research question or hypothesis, but also facilitates data validity, 
appropriate analyses, and accurate interpretation of findings - all of which are ex¬ 
tremely important when gleaning insights from massive amounts of data. 

Rick Guzzo (RG): I don’t think 1-0 can be declared a pioneer in the development of 
big data applications in organizations by any means, but I do think that many of the 
core principles of 1-0 training are quite useful in making the most of big data opportuni¬ 
ties. Some of those relate to the field’s basic criteria for meaningful measurement such 
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as an unwillingness to accept any apparent proxy as an indicator of an underlying 
construct. That’s an easy trap for a data scientist without 1-0 training, for example. I 
also think l-O’s anchors in traditional analytics can be both a drag on the field’s adop¬ 
tion of new-wave analytics but at the same time provide a meaningful reference 
against which to understand the real value of new forms of analysis. 

What is most important for leaders to understand about using big data? 

AF: Big data is not the only game in town. Big data is a complement, not a re¬ 
placement, for other methodologies. Good talent analytics functions will continue to 
employ multiple methods, including classic experimental methods, qualitative meth¬ 
ods, and "little data" studies. The best research projects often use an ensemble ap¬ 
proach where multiple methods are used together. 

RG: Getting value out of big data is a team effort. Roughly speaking, there are 
three broad sets of skills that have to come together. One is about data prep, the 
ability to integrate and reconcile data from diverse sources and make it analyzable. A 
second set of skills is analyzing. And a third set is bridging from the results of analy¬ 
sis to implication and action, to speak to the consumers of the analytic work. As a 
leader you will be lucky to find an individual who is good at two of them at the same 
time. Success with analytics really requires teams of people with complementary 
skills. 
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Big data is not the 
only game in town. 

Big data is a 
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other methodologies 


What is the best way to approach big data sets in organizations? 

AF: It’s so easy to be like a kid in a candy shop when presented with a gigantic da¬ 
taset. Data mining gives you all kinds of little thrills of discovery! However, my advice 
is to take a deep breath and start by identifying meaningful questions, with an end 
goal of being able to intervene in the system and make some change based on in¬ 
sights. For example, if you are looking at exit data, a random forest analysis might be 
able to tell you with high precision WHO is going to leave the organization. But that 
analysis typically can't tell you anything about why they are leaving, or how you might 
entice them to stay. The best way to approach big data is the best way to approach 
any research opportunity: identify a key decision or action you would like to inform, 
and conduct an analysis designed to provide insight on the best course of action. 

Big data often contains transactional data that are not particularly relevant, or such a 
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sheer number of variables and data points that random variation will produce at least 
some apparently strong relationships. A clear idea of what you are looking for, and 
why you are looking for it will help you avoid being distracted by bright shiny objects. 

SR: I approach big data sets by keeping the following 5 “rules” in mind. 

1. Always start with a question, problem, or a decision - don’t start with the data or 
analyses. This will increase the likelihood that your big data initiative will lead to an 
action. Your question, problem, or decision should be relevant and important to busi¬ 
ness leaders. Your question, problem, or decision should be relevant and important 
to business leaders. 

2. Make sure you utilize the appropriate research methods, data sources, sampling 
techniques, measurement tools, and statistical analyses. This will increase the accu¬ 
racy of your findings. 

3. Don’t mistake “data digging” for data science - keep in mind that findings from dig¬ 
ging expeditions may just be error (i.e., due to chance). 

4. Don’t forget to do something with your findings - digging through data for the sake 
of curiosity doesn’t help you or your company. 

5. If you want someone to do something with your findings, learn how to tell a story 
with data and use data visualization to communicate findings in a clear and consum¬ 
able manner. If a table or graph cannot be interpreted in three seconds or less, it’s 
too complicated. 

How can you ensure big data drives business decisions? 

SR: There are five things you should always do if you want your big data initia¬ 
tive to drive business decisions. First, develop a positive, trusting, and collaborative 
relationship with the leader who has decision rights over the area of the business 
you are examining. Second, work with this leader to collaboratively identify a busi¬ 
ness question or problem that is in need of being addressed. Third, deliver findings 
in a clear, compelling, and consumable manner by avoiding technical jargon, compli- 



5 “Rules” For Approaching Big Data Sets 


1. Always start with a question, problem, or a decision - don’t start with the 
data or analyses. 

2. Make sure you utilize the appropriate research methods, data sources, 
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cated tables, busy graphs, etc. and ensure that you tai¬ 
lor your delivery to the audience. Fourth, offer one or 
two very specific recommended actions that are feasi¬ 
ble and can be implemented with minimal resources. 
Finally, stay involved throughout the implementation, 
preferably by measuring the impact of action. 

RG: Big data, and by that I mean both volume and 
variety of observations as well as alternative ways of 
analyzing them, creates an opportunity to “see” behav¬ 
ior and organizations in novel ways. Using data to bring 
new insights and solutions to old and familiar problems 
is one way of significantly influencing business deci¬ 
sions. 

What are some common misconceptions about us¬ 
ing big data? 

RG: I think misconceptions abound at the front end 
and at the back end. At the front end it is easy to under¬ 
estimate how much work is required to integrate diverse 
data into a form useful for analysis. At the back end I 
think there is a misconception about just how much cer¬ 
tainty and precision are delivered by big data analytics. 
We are better off with them, without doubt, but they 
leave us with considerable room for continued improve¬ 
ment in prediction and interpretation. 

Is “Big Data” always better? 

AF: No. Big Data is powerful, but not right for every 
question or influence opportunity. For example, big data 
is often based on the past, and organizations in periods 
of dramatic transition, or organizations seeking signifi¬ 
cant transformation are likely to need entirely different 
methods, such as significant qualitative work. There 
are often times where the active research process is 
part of an intervention in an organization - passively col¬ 
lected big data would miss that influencing opportunity. 

SR: No. The purpose of any analytic initiative 
should be to drive action and inform decisions. As a re¬ 
sult, it is important to identify the optimal research de¬ 
sign, data sources, and statistical analytics that will pro¬ 
vide valid and reliable findings related to your business 
question. In some cases, this may require extremely 
large datasets. However, in others it may require a very 
small and focused research study on a small popula¬ 
tion. Therefore, “big” is not always better. 
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RG: Almost always, yes. Once it is organized, the value of the new insights that 
more data can provide outweighs the low costs of analyzing it. 

Where should practitioners start? Where can I learn more? 

SR: Always start by identifying a business question, problem, or decision. This 
will help you stay focused, and reduce analysis paralysis by analyzing any metric you 
have available to you. One you have your question documented, then think about how 
you would go about answering the question (i.e., your research design). Then create a 
list of constructs or metrics you would need in order to answer the question, and identi¬ 
fy whether they exist or need to be collected. Once you’ve completed these steps, 
you’ve build a foundation for your big (or small) data initiative and can move into ana¬ 
lyzing the data, storyboarding your findings, and developing your deliverables inclusive 
of both findings and recommended actions. If you are interested in learning more about 
this topic, there is a plethora of articles that have been published on Linkedln Pulse 
that provide tips and tricks related to analytics. 

RG: There are terrific resources available for free these days to train up in big 
data analytics. I've found the book An Introduction to Statistical Learning (2015) by 
Gareth James et al. to be an excellent resource, for example. And there are plenty of 
on-line courses available, many at reasonable prices ~ check out datacamp.com as 
one illustration. That said, I think the successful application of those techniques to com¬ 
plicated, messy applied issues requires a fair amount of apprenticeship and learning 
from experience. 
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